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(54) AbstractTitle 

Processing phase information of acoustic 

(57) A device for processing the phase information of an acoustic signal processes the phase information of a 
digital speech signal which is expressed as a discrete sum of periodic signals having different frequency 
components. The device includes a critical bandw/idth calculator (100) for calculating the critical bandwidth of 
each frequency according to the bandwidth characteristics of a human's auditory filter, a frequency range 
setting unit (102) for setting the frequency ranges of local phase changes using critical bandwidths corrected 
by multiplying the critical bandwidths by a predetermined scaling coefficient a, and a phase significance 
discriminator (104) for checking whether frequency components adjacent to each frequency are within the 
frequency range corresponding to the frequency, and discriminating whether the phase of a signal having the 
frequency component is significant in terms of auditory characteristics. Accordingly, phase components which 
are significant for auditory perception can be discriminated among the phase components of an acoustic 
signal. When applied to speech coding, only phase components significant upon auditory perception can be 
selectively coded among the components of an acoustic signal. Thus, a good quality of sound can be obtained 
as compared to a method in whiclithe phase information of an acoustic signal is not coded, and the amount of 
information can be reduced as compared to a method of coding all phase information. 
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DEVICE FOR PROCESSING PHASE INFORMATION 
OF ACOUSTIC SIGNAL AND METHOD THEREOF 

5 

The present invention relates to a device for processing the phase information of 
an acoustic signal and a method thereof, and more particularly, to a device for processing 
the phase information of an acoustic signal, by which important phase components are 
discriminated in consideration of human auditory recognition characteristics, and a method 
10 thereof. 

Research into auditory psychophysics due to a change in the phase of an acoustic 
signal is in progress, but useful results have not yet been obtained in large numbers. The 
research results into auditory psychophysics due to a change in the phase of acoustic 
signals are disclosed by E. Zwicker and H. Fasti, ["Psychoacoustics-Facts and Models", 

15 Springer- Verlag, 2"^ Eds, 1999], and B.C. J.Moore, ["Introduction to the Psychology of 
Hearing", Academic Press, 4'* Eds., 1997]. According to ±ese documents, the cochlea 
of the internal ear among hearing organs can be modeled as a filter bank. The filter bank 
includes band pass filters, and the passband of each filter can be estimated when the 
central frequency of the filter is given. Signal processing within a human ear has been 

20 known as multi-channel signal processing preformed in units of each critical band of the 
filter. 

When a phase change in a signal is considered from this standpoint, a local phase 
change denotes a change in the relative phase relationship between signal components 
which exist within the same critical band (i.e., within the same channel). A global phase 

25 change denotes that the phase relationship between channels varies while the relative 
phase relationship between signal components within the same critical band is being kept. 
The human ear is dull to global phase changes and somewhat sensitive to local phase 
changes, which is not completely theorized but known in relation to auditory 
psychophysics with respect to phase. This is disclosed by R.D. Patterson, ["A Pulse 

30 Ribbon Model of Monaural Phase Perception", J. Acoust. Soc. Am., Vol. 82, No. 5, pp. 
1560-1586, 1987]; and M.R. Schroeder, ["New Results Concerning Monaural Phase 
Sensitivity", J. Acoust. Soc. Am, Vol. 31, p. 1579, 1959]. 
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Also, phase information processing in a harmonic speech system is disclosed by 
R.J. MacAuIary and T.F. Quatieri, "Sinusoidal Coding in Speech Coding and Synthesis", 
W.B. KleijnandK.K. Palivwal Eds, Elsevier, pp. 121-173, 1998; J.S. Marques and L.B. 
Almeida, "Sinusoidal Modeling of Voiced and Unvoiced Speech", in Proc. ICASSP, pp. 
5 203-206, 1983; and J.S. Marques, L.B. Almeida, and J.M. Tribolet, "Harmonic coding 
at 4.8kb/s", in Proc. ICASSP, pp. 17-20, 1990. According to these documents, a 
harmonic speech coding system can be used to express the excitation signal of speech 
using the following Equation 1: 

K 

e(n)=^A,^cos(k£Hon+ $;^) ..(1) 

10 4=1 

wherein Wq denotes a fundamental frequency, A^ denotes the spectral magnitude of 
harmonics, and ^„ denotes the phase of harmonics. The excitation signal is used as the 
input to a filter which has been modeled by the spectral envelope of speech, to thereby 
finally obtain an acoustic signal. Thus, in a speech coding system, spectrum envelope 
1 5 filter coefficients, the spectral magnimde A^, the fundamental frequency cJq, and the phase 
of harmonics (^t) are quantized and transmitted, and acoustic signals are synthesized using 
the received parameters. In present harmonic speech coding systems, the spectrum phase 
information 5^ is relatively neglected compared to the spectral magnitude information A^ 
of a signal, and a method in which a transmission system does not send the phase 
2Q information of an acoustic signal, but a reception system applies an arbitrary phase using 
the condition that the phase of an acoustic signal continuously changes, is generally used. 

However, an acoustic signal synthesized by the conventional method does not 
provide a satisfactory quality of sound. Also, when phase information is completely 
coded to solve this problem, the amount of information increases too much. 
25 The present invention seeks to provide an acoustic signal phase information 

processing device and method, in which important phase components are discriminated 
in consideration of human auditory characteristics to selectively code or synthesize the 
phase components of an acoustic signal. 

According to a first aspect of the present invention, there is provided a device for 
30 processing the phase information of a digital speech signal which is expressed as a 
discrete sum of periodic signals having different frequency components comprising a 
critical bandwidth calculator for calculating the critical bandwidth of each frequency 
according to the bandwidth characteristics of a human's auditory filter a frequency range 
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setting unit for setting the frequency ranges of local phase changes using critical 
bandwidths corrected by multiplying the critical bandwidths by a predetermined scaling 
coefficient, and a phase significance discriminator for checking whether frequency 
components adjacent to each frequency are within the frequency range corresponding to 
5 the fi-equency, and discriminating whether the phase of a signal having die frequency 
component is significant in terms of auditory characteristics. 

Preferably, the device further includes an acoustic signal transformer for 
transforming an acoustic signal into the discrete sum of periodic signals having different 
frequency components. Also, it is preferable that the scaling coefficient is smaller than 
10 1. Preferably, the phase significance discriminator obtains an assembly of frequencies 
having phases that are significant m terms of auditory characteristics. 

According to a second aspect of die present invention, diere is provided a device 
for processing the phase components of an acoustic signal comprising an acoustic signal 
transformer for transforming an acoustic signal into s(n)= J] A, cos((a,/7+ . wherein 
15 L is an integer greater than 1 , A,, w,, and 5, denote the spectral magnitude, frequency, and 
phase of an 1-th periodic signal, respectively, and w, < u j< . . . < a critical bandwidth 
calculator for calculating die critical bandwiddi of each frequency according to the 
bandwidth characteristics of a human's auditory filter; a frequency range setting unit for 
obtaining critical bandwidths 

cJl> ub ^1, LB corrected by multiplying the critical 
20 bandwidths by a predetermined scaling coefficient, and setting a frequency set of a 
channel satisfying the condition of w,xb^^^^Wi with the frequency u, set as an upper 
bound, to be C(w„l), and setting a frequency set of a channel satisfying die condition of 
w,<oj<cij|. UB with the frequency cj, set as a lower bound, to be C(w„2); and a phase 
significance discriminator for discriminating whedier the conditions of cjn £ C(a>,, I) and 
25 € C(w„2) are satisfied widi respect to cj„ and outputting significance data 

representing that the phase 6t of die frequency w, is not significant in terms of auditory 
characteristics, if the conditions are satisfied, and odierwise, outputting significance data 
representing that the phase ^, of die frequency w, is significant in terms of auditory 
characteristics. 

30 According to a third aspect of the present invention, diere is provided a method 

of processing the phase components of an acoustic signal comprising die steps of (a) 
expressing an acoustic signal as a discrete sum of periodic signals having different 
frequency components, (b) calculating the critical bandwidth of each frequency according 
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to the bandwidth characteristics of a human's auditory filter, (c) obtaining corrected 
critical bandwidths by multiplying the critical bandwiddis by a predetermined scaling 
coefficient, (d) setting the frequency ranges of local phase changes using the critical 
bandwidths corrected in step (c), and (e) checking whether frequency components adjacent 
5 to each frequency are within the frequency range corresponding to the firequency, and 
discriminating whether the phase of a signal having the frequency component is significant 
in terms of auditory characteristics. 

According to a fourth aspect of the present invention, there is provided a method 
of processing the phase components of an acoustic signal comprising (a) expressing an 
10 acoustic signal as s{n) = X 4 cos(fi>i« + ) , wherein L is an integer greater than 
1, A„ cj[, and 6, denote the spectral magnitude, frequency, and phase of an 1-th periodic 
signal, respectively, and w, < u, < ...< Wl; (b) calculating the critical bandvi^idth of 
each frequency according to the bandwidth characteristics of a human's auditory filter; 
(c) obtaining critical bandwidths w„ ub and o),, lb corrected by multiplying the critical 
15 bandwidths by a predetermined scaling coefficient; (d) setting the frequency w, as an 
upper bound and setting a frequency set of a channel satisfying the condition of «]_ 
[,B^w<a>, to be C(oji, I); (e) setting the frequency w, as a lower bound and setting the 
frequency assembly of a channel satisfying the condition of w, < w ^ w„ub. to be C(cj,, 2); 
and (e-1) determining the phase ^, of the frequency w, as a phase which is not significant 
20 in terms of auditory characteristics, if the conditions are satisfied in step (e); and (e-2) 
determining the phase 5, of the frequency cjI as a phase which is significant in terms of 
auditory characteristics, if the conditions are not satisfied in step (e); (f) determining 
whether I is L, and concluding the process if the I is L, and otherwise, increasing the I 
by one and returning to the step (e). 
25 Examples of the present invention will now be described in detail with reference 

to the accompanying drawings, in which: 

Figure 1 is a block diagram illustrating the structure of a device for processing the 
phase information of an acoustic signal, according to an embodiment of the present 
invention; 

30 Figure 2 is a flowchart illustrating a method of processing the phase information 

of an acoustic signal, according to an embodiment of the present invention; 

Figures 3A and 3B are views for illustrating a process for discriminating the phase 
importance in the device according to the present invention; 
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Figure 4 is a graph showing a process for discriminating the phase importance 
with respect to a harmonic signal in the device according to the present invention; 

Figure 5 is a waveform diagram illustrating the acoustic waveforms of a woman's 
speech in an NTT Advanced Technology Corporation (NATC: registered trademark) 
5 database; and 

Figures 6 and 7 are graphs for explaining a reduction in phase transmission 
amount with respect to the speech of Figure 5. 

Referring to Figures 1 and 2, a device for processing the phase information of an 
acoustic signal according to the present invention includes a critical bandwidth calculator 
10 100, a frequency range setting unit 102, and a phase significance discrimination unit 104. 

In the operation of the device, first, it is assumed that a digital signal to be 
synthesized can be expressed as in the following Equation 2: 

L 

s(n)=Y,A'^osi6)in+ ff,) --(2) 

/=! 

1 5 wherein L is an integer greater than 1 , A, denotes the amplimde of an 1-th periodic signal, 
cj, denotes the frequency thereof, ^, denotes the phase thereof, and u, <W2 <•..< 
in step 200. The digital signal is expressed as a line spectrum in each co, in the frequency 
domain. A transformer (not shown) for transforming an acoustic signal into the discrete 
sum of periodic signals having different firequencies, many be further included as 

20 necessary. 

The critical bandwidth calculator 100 calculates the critical bandwidths of channels 
corresponding to a human's auditory filter according to the bandwidth characteristics of 
the human's auditory filter, in step 202. For example, an equivalent rectangular 
bandwidth (ERB) or a bark scale can be applied as the bandwidth characteristics of die 

25 human's auditory filter. 

The ft-equency range setting unit 102 obtains corrected critical bandwidths by 
multiplying the critical bandwidths by a predetermined scaling coefficient (a), in step 204. 
The frequency range setting unit 102 also sets the frequency ranges w, ub and u,. lb of ^ 
local phase change using die corrected critical bandwidths, in step 206. In the present 

30 embodiment, it is assumed diat the scaling coefficient (a) is 1, and the frequency ranges 
0),. UB and w,. lb are the same as the corrected critical bandwidths. It is preferable that the 
scaling coefficient (a) can be controlled by auditory experiments, and is smaller than 1. 
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Also, the frequency ranges w, ^3 and aj,_ lb can also be controlled to some extent by the 
auditory experiments. 

The frequency range setting unit 102 also sets a frequency set of a channel 
satisfying the condition of co,, |_g^Gj<cjj, wherein the frequency coj is set as an upper 
5 bound, to be C(cj„ 1) and sets a frequency set of a channel satisfying the condition of u, 
<a}< wherein the frequency w, is set as a lower bound, to be C(cj„ 2), in step 

208. 

In step 220, the phase significance discrimination unit 104 discriminates whether 
w, satisfies the conditions shown in the following Inequality 3: 

0},_,i C{mi,\)and<ai^^€C{cOi,2) -(3) 

That is, the phase significance discrimination unit 104 determines the phase 5, of the 
frequency w, as a phase that is not significant in terms of auditory charaaeristics, if the 
conditions shown in Inequality 3 are satisfied, m step 222. Otherwise, the phase 
15 significance discrimination unit 104 determines the phase ^, of the frequency w, as a phase 
that is significant in terms of auditory characteristics, in step 224. That is, the phase tf, 
of the frequency oj, satisfying the conditions shown in Inequality 3 is determined as a 
phase which is not significant in terms of auditory characteristics. Thus, the phase 
significance discrimination unit 104 discriminates whether the conditions of w,., ^ C(«„l) 

20 and 1 € C(w„2) are satisfied with respect to cj,. If the conditions shown in Inequality 
3 are satisfied, the phase significance discrimination unit 104 outputs phase significance 
data representing that the phase 5, of the frequency cj, is not significant in terms of 
auditory characteristics, and otherwise, it outputs phase significance data representing that 
the phase 5, of the frequency u, is significant in terms of auditory characteristics. 

25 Also, the phase significance discrimination unit 104 checks if a parameter I has 

reached L, in step 226. If the parameter I has reached N, the discrimination process is 
concluded. Otherwise, the parameter I is increased by 1, and dien the steps 220, 222 and 
224 are repeated. Therefore, discrimination with respect to the phase of each frequency 
component is performed. 

30 Figures 3A and 3B are views for explaining a process for discriminating the phase 

significance, wherein Figure 3A refers to when Inequality 3 is satisfied and Figure 3B 
refers to when Inequality 3 is not satisfied. 



6 



Referring to Figure 3A,6), satisfies the conditions of ^ C(U|,1) and ^ 
C(Wi,2) As described above, when satisfies the conditions shown in Inequality 3, only 
the frequency component of the frequency o), lies within a channel. Thus, even if the 
phase di is synthesized or coded with an arbitrary phase value, the relative phase 
relationship within a channel is maintained, and does not affect other channels. 
Consequently, even if a signal having a different phase to the phase of the original signal 
is applied, it is very difficult to audibly perceive the difference. 

Referring to Figure SB, w, satisfies the conditions of Wn € C(w„l) and 0?^., G 
C(w„2), so the conditions shown in Inequality 3 are not satisfied. As described above, 
when Wi does not satisfy the conditions shown in Inequality 3, other frequency 
components mix within a channel. A phase change in this frequency causes a change in 
the relative phase relationship. Thus, a phase change greater than or equal to a certain 
amount can be audibly perceived. Consequently, if a corresponding frequency is 
synthesized with an arbitrary phase, a difference can be audibly perceived. 

Figure 4 is graph showing a process for discriminating the phase significance with 
respect to a hafmonic signal in the device according to the present invention. 
In Figure 4, the horizontal axis represents the frequency of a harmonic signal in Hz, and 
the vertical axis represents the amplitude of the harmonic signal. 

Generally, in view of human auditory characteristics, the critical bandwidth 
becomes wider as the frequency increases. Thus, a frequency component corresponding 
to a frequency of lOOHz to 600Hz is not included within two different critical 
bandwidths. Thus, the phase of this frequency is not important in terms of human 
auditory characteristics as described above with reference to Figure 3A. On the other 
hand, a frequency component corresponding to a frequency of 700Hz to lOOOHz can be 
included within two different critical bandwidths. Thus, a phase change in this frequency 
can be perceived by the human ear as described above with reference to Figure 3B. 

This device and method for processing the phase information of an acoustic signal 
can be applied to speech coding. That is, upon coding, only phase components which are 
significant in terms of auditory characteristics are coded or synthesized. Upon decoding, 
even if uncoded phase components, that is, phase components that are not significant in 
terms of auditory characteristics, are synthesized by applying an arbitrary value, the 
difference can hardly be audibly perceived because of the human auditory characteristics. 
Therefore, phase components are transmitted or synthesized by applying the device and 
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method for processing the phase information of an acoustic signal according to the present 
invention, so that the quality of sound can be improved. Also, the amount of phase 
information required can be reduced. 

Figure 5 is a waveform diagram illustrating the acoustic waveform of a woman's 
speech in an NTT Advanced Technology Corporation (NATC: registered trademark) 
database. Figure 6 shows a comparison of the number of phase components to be 
transmitted when a method according to the present invention is applied to the speech of 
Figure 5 and when a conventional method is applied to the speech of Figure 5, according 
to the lapse of time. Referring to Figure 6, when the conventional method is applied, the 
number of phase components to be transmitted according to the lapse of time is indicated 
by an unbroken line. When the method of the present invention is applied, frequency 
components, which are included one by one in an auditory channel, exist in a 
predetermined range of a low frequency, and may not be transmitted. Thus, the number 
of phase components to be transmitted is reduced. The number of phase components to 
be transmitted according to the present invention is indicated by a dotted line. Non- 
transmitted phase components are arbitrarily synthesized on the basis of consecutive phase 
change conditions. Here, as the results of an ERB experiment, there is no difference in 
auditory perception between speech synthesized using the phase components indicated by 
the unbroken line which transmitted through an auditory channel, and speech synthesized 
using only the phase components indicated by a dotted line which are transmitted 
therethrough. Figure 7 shows percent decrease in the number of phase components by 
applying the present invention. 

As described above, in the device and method of processing the phase information 
of an acoustic signal according to the present invention, significant phase components in 
terms of auditory perception can be discriminated among the components of an acoustic 
signal. 

Also, when the device and method of processing the phase information of an 
acoustic signal according to the present invention are applied to speech coding, only the 
significant phase components in terms of auditory perception are selectively coded among 
the components of an acoustic signal. Thus, a good quality of sound can be obtained as 
compared to a method in which the phase information of an acoustic signal is not coded, 
and the amount of information can be reduced as compared to a method of coding all 
phase information. Also, it will be understood by one of ordinary skill in the an that 



these effects can be equally obtained from the fields of speech synthesis and speech 
transmission. 
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Claims 

1. A device for processing the phase information of a digital speech signal 
which is expressed as a discrete sum of periodic signals having different frequency 
components, comprising: 

a critical bandwidth calculator for calculating the critical bandwidth of each 
frequency according to the bandwidth characteristics of a human's auditory filter; 

a frequency range setting unit for setting the frequency ranges of local phase 
changes using critical bandwidths corrected by multiplying the critical bandwidths by a 
predetermined scaling coefficient; and 

a phase significance discriminator for checking whether frequency components 
adjacent to each frequency are within the frequency range corresponding to the frequency, 
and discriminating whether the phase of a signal having the frequency component is 
significant in terms of auditory characteristics. 

2. , A device according to claim 1, further comprising an acoustic signal 
transformer for transforming an acoustic signal into the discrete sum of periodic signals 
having different frequency components. 

3. A device according to claim 1 or 2, wherein the scaling coefficient is 
smaller than 1 . 

4. A device according to claim 1, 2 or 3, wherein the phase significance 
discriminator obtains an assembly of frequencies having phases that are significant in 
terms of auditory characteristics. 

5. A device for processing the phase components of an acoustic signal, 
comprising: 

an acoustic signal transformer for transforming an acoustic signal into 
= 2] 4 cos((y ,/7 + fft) ' wherein L is an integer greater tiian 1 , Ai. w„ and 5, denote 
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the spectral magnitude, frequency, and phase of an 1-th periodic signal, respectively, and 
oj, < o)^< ...<cci^; 

a critical bandwidth calculator for calculating the critical bandwidth of each 
frequency according to the bandwidth characteristics of a human's auditory filter; 
5 a frequency range setting unit for obtaining critical bandwidths Wl, ub and w, lb 

corrected by multiplying the critical bandwidths by a predetermined scaling coefficient, 
and setting a frequency set of a chaimel satisfying the condition of aji,LB<w<a3, with the 
frequency o, set as an upper bound, to be C(a)],l), and setting a frequency set of a 
chaimel satisfying the condition of cji<a)<a), ub with the frequency w, set as a lower 
10 bound, to be C(w,,2); and 

a phase significance discriminator for discriminating whether the conditions of co,., 
^ C(w,,l) and ^ C(a)[,2) are satisfied with respect to w,, and outputting significance 
data representing that the phase ^, of the frequency w, is not significant in terms of 
auditory characteristics, if the conditions are satisfied, and otherwise, outputting 
15 significance data representing that the phase 5, of the frequency co, is signiiicant in terms 
of auditory characteristics. 

6. A method of processing the phase components of an acoustic signal, 
comprising the steps of: 
20 (a) expressing an acoustic signal as a discrete sum of periodic signals having 

different frequency components; 

(b) calculating the critical bandwidth of each frequency according to the bandwidth 
characteristics of a human's auditory filter; 

(c) obtaining corrected critical bandwidths by multiplying the critical bandwidths 
25 by a predetermined scaling coefficient; 

(d) setting the frequency ranges of local phase changes using the critical 
bandwidths corrected in step (c); and 

(e) checking whether frequency components adjacent to each frequency are within 
the frequency range corresponding to the frequency, and discriminating whether the phase 

30 of a signal having the frequency component is significant in terms of auditory 
characteristics. 
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7. A method according to claim 6, wherein the scaling coefficient is smaller 

than 1. 

8. A method of processing the phase components of an acoustic signal, 
5 comprising the steps of: ^ 

(a) expressing an acoustic signal as s{n)=Y, cos(i0,«+ , wherein L is an 
integer greater dian 1, A,, w,, and 5, denote the spectral magnitude, frequency, and phase 
of an 1-th periodic signal, respectively, and w, < < •■• < w^; 

(b) calculating the critical bandwidth of each frequency according to the bandwidth 
10 characteristics of a human's auditory filter; 

(c) obtaining critical bandwidths u„ ub and cj„ lb corrected by multiplying the 
critical bandwidths by a predetermined scaling coefficient; 

(d) setting die frequency oj, as an upper bound and setting a frequency set of a 
channel satisfying die condition of o), lb^<^^w, to be C(c<),, 1); 

15 (e) setting die fi-equency w, as a lower bound and setting the frequency assembly 

of a channel satisfying the condition of cj,<a)^u„uB, to be C(c«),, 2); and 

(e-1) determining the phase 5, of the frequency w, as a phase which is not 
significant in terms of auditory characteristics, if the conditions are satisfied in step (e); 
and 

20 (e-2) determining die phase ^, of die frequency cjI as a phase which is 

significant in terms of auditory characteristics, if die conditions are not satisfied in step 

(e); 

(f) determining whether I is L, and concluding the process if die I is L, and 
otherwise, increasing the I by one and returning to die step (e). 

25 

9. A device for processing the phase information of a digital speech signal as 
herein described widi reference to die accompanying drawings. 

10. A device for processing the phase components of an acoustic signal as 
30 herein described with reference to the accompanying drawings. 

11. A method of processing the phase components of an acoustic signal as 
herein described with reference to the accompanying drawings. 
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